Comparing the Effectiveness of a Clinical Decision Support Tool in Reducing Pediatric Opioid Dose Calculation Errors: PediPain App vs. Traditional Calculators - A Simulation-Based Randomised Controlled Study.

Wrong dose calculation medication errors are widespread in pediatric patients mainly due to weight-based dosing. PediPain app is a clinical decision support tool that provides weight- and age- based dosages for various analgesics. We hypothesized that the use of a clinical decision support tool, the PediPain app versus pocket calculators for calculating pain medication dosages in children reduces the incidence of wrong dosage calculations and shortens the time taken for calculations. The study was a randomised controlled trial comparing the PediPain app vs. pocket calculator for performing eight weight-based calculations for opioids and other analgesics. Participants were healthcare providers routinely administering opioids and other analgesics in their practice. The primary outcome was the incidence of wrong dose calculations. Secondary outcomes were the incidence of wrong dose calculations in simple versus complex calculations; time taken to complete calculations; the occurrence of tenfold; hundredfold errors; and wrong-key presses. A total of 140 residents, fellows and nurses were recruited between June 2018 and November 2019; 70 participants were randomized to control group (pocket calculator) and 70 to the intervention group (PediPain App). After randomization two participants assigned to PediPain group completed the simulation in the control group by mistake. Analysis was by intention-to-treat (PediPain app = 68 participants, pocket calculator = 72 participants). The overall incidence of wrong dose calculation was 178/576 (30.9%) for the control and 23/544 (4.23%) for PediPain App, P < 0·001. The risk difference was - 32.8% [-38.7%, -26.9%] for complex and - 20.5% [-26.3%, -14.8%] for simple calculations. Calculations took longer within control group (median of 69 Sects. [50, 96]) compared to PediPain app group, (median 48 Sects. [38, 63]), P < 0.001. There were no differences in other secondary outcomes. A weight-based clinical decision support tool, the PediPain app reduced the incidence of wrong doses calculation. Clinical decision support tools calculating medications may be valuable instruments for reducing medication errors, especially in the pediatric population.

Registries in pediatric anesthesiology: A brief history and a new way forward.

Clinical registries are multicenter prospective observational datasets that have been used to examine current perioperative practices in pediatric anesthesia. These datasets have proven useful in quantifying the incidence of rare adverse outcomes. Data from registries can highlight associations between severe patient safety events and patient and procedure-related risk factors. Registries are an effective tool to delineate practices and outcomes in niche patient populations. They have been used to quantify uncommon complications of medications and procedures. Registries can be used to generate knowledge and to support quality improvement. Multicenter engagement can promote best clinical practices and foster professional networks. Registries are limited by their observational nature, which entails a lack of randomization as well as selection and treatment bias. The maintenance of registries over time can be challenging due to difficulties in modifying the included variables, collaborator fatigue, and continued outlay of resources to maintain the database and onboard new sites. These latter issues can lead to decreased data quality. In this article, we discuss key insights from several pediatric anesthesia registries and propose a new type of registry that addresses some shortcomings of the current paradigm.

Refocusing on work-based hazards for the anaesthesiologist in a post-pandemic era.

The coronavirus pandemic has raised public awareness of one of the many hazards that healthcare workers face daily: exposure to harmful pathogens. The anaesthesia workplace encompasses the operating room, interventional radiology suite, and other sites that contain many other potential occupational and environmental hazards. This review article highlights the work-based hazards that anaesthesiologists and other clinicians may encounter in the anaesthesia workplace: ergonomic design, physical, chemical, fire, biological, or psychological hazards. As the anaesthesia work environment enters a post-COVID-19 pandemic phase, anaesthesiologists will do well to review and consider these hazards. The current review includes proposed solutions to some hazards and identifies opportunities for future research.

Machine Vision and Image Analysis in Anesthesia: Narrative Review and Future Prospects.

Machine vision describes the use of artificial intelligence to interpret, analyze, and derive predictions from image or video data. Machine vision-based techniques are already in clinical use in radiology, ophthalmology, and dermatology, where some applications currently equal or exceed the performance of specialty physicians in areas of image interpretation. While machine vision in anesthesia has many potential applications, its development remains in its infancy in our specialty. Early research for machine vision in anesthesia has focused on automated recognition of anatomical structures during ultrasound-guided regional anesthesia or line insertion; recognition of the glottic opening and vocal cords during video laryngoscopy; prediction of the difficult airway using facial images; and clinical alerts for endobronchial intubation detected on chest radiograph. Current machine vision applications measuring the distance between endotracheal tube tip and carina have demonstrated noninferior performance compared to board-certified physicians. The performance and potential uses of machine vision for anesthesia will only grow with the advancement of underlying machine vision algorithm technical performance developed outside of medicine, such as convolutional neural networks and transfer learning. This article summarizes recently published works of interest, provides a brief overview of techniques used to create machine vision applications, explains frequently used terms, and discusses challenges the specialty will encounter as we embrace the advantages that this technology may bring to future clinical practice and patient care. As machine vision emerges onto the clinical stage, it is critically important that anesthesiologists are prepared to confidently assess which of these devices are safe, appropriate, and bring added value to patient care.

The role of WhatsApp™ in pediatric difficult airway management: A study from the PeDI Collaborative.

BACKGROUND: Management of the pediatric difficult airway can present unique clinical challenges. The Pediatric Difficult Intubation Collaborative (PeDI-C) is an international collaborative group engaging in quality improvement and research in children with difficult airways. The PeDI-C established a WhatsApp™ group to facilitate real-time discussions around the management of the difficult airway in pediatric patients. The goals of this study were to evaluate the patterns of use of the WhatsApp™ group, themes on messages posted on pediatric difficult airway management and to assess the perceived usefulness of the WhatsApp™ group by the PeDI-C members. METHOD: Following research ethics approval, we performed a database analysis on the archived discussion of the PeDI-C WhatsApp™ group from 2014 to 2019 and surveyed members to assess the perceived usefulness of the PeDI-C WhatsApp™ group. RESULTS: 5781 messages were reviewed with 350 (6.0%) original stems. The three most common original stem types were advice seeking 98 (28%), announcements 85 (24.2%), and clinical case-sharing 78 (22.2%). The median number of responses to original stems was 9 [2-21.3]. Post types associated with increased responses included those seeking advice on medication/equipment (regression coefficient 0.78, 95% CI [0.41-1.16]; p < .0001); seeking advice on patient care (regression coefficient 1.16, 95% CI [0.86-1.45]; p < .0001), sharing advice on medication/equipment availability (regression coefficient 0.87, 95% CI [0.33-1.40], p < .0016), and clinical case-sharing (regression coefficient 1.2547, 95% CI [0.9401-1.5693] p < .0001). 46/64 members of the group responded to the survey. Replies offering advice regarding patient management scenarios were found to be of most interest and 77% of surveyed members found the discussion translatable into their own clinical practice. DISCUSSION: The PeDI-C WhatsApp™ group has facilitated timely knowledge exchange on pediatric difficult airway management across the world. Participants are satisfied with the role the Whatsapp™ group is playing.

The influence of resident and faculty gender on assessments in anesthesia competency-based medical education.

PURPOSE: Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system. METHODS: This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome-gender-based differences in entrustment ratings of residents on the ACEA and EPAs-was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored. RESULTS: In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender. CONCLUSION: We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores.

RéSUMé: OBJECTIF: La formation médicale fondée sur les compétences (FMFC) repose sur des évaluations fréquentes des stagiaires en milieu de travail, ce qui donne l'occasion de refléter les préjugés conscients et implicites dans ces évaluations. Notre objectif était d'examiner l'influence du genre des résident·es et des professeur·es sur les évaluations de la performance des résident·es au sein d'un système de FMFC. MéTHODE: Cette étude de cohorte rétrospective s'est déroulée d'août 2017 à janvier 2021 à l'aide des données d'évaluation des résident·es provenant de deux évaluations en milieu de travail : L'évaluation de l'anesthésie clinique par événement (ACEA ­ Anesthesia Clinical Encounter Assessment) et les Actes professionnels non supervisés (APNS). Des données autodéclarées sur le genre ont également été extraites. Le critère d'évaluation principal, soit les différences fondées sur le genre dans les cotes de confiance des résident·es sur l'ACEA et les APNS, a été évalué à l'aide d'une régression logistique à effets mixtes, les différences étant rapportées par les rapports de cotes et les intervalles de confiance (α = 0,01). Les différences fondées sur le genre dans la réception des commentaires en texte libre sur l'ACEA et les APNS ont également été explorées. RéSULTATS: Au total, 14 376 évaluations ACEA et 4467 évaluations APNS ont été analysées. Il n'y avait pas de différences significatives dans les cotes de confiance obtenues avec l'un ou l'autre des outils d'évaluation entre les résidents et les résidentes. Indépendamment du genre de la personne réalisant l'évaluation, les taux de confiance entre les résidentes et les résidents n'étaient pas significativement différents pour toutes les années de formation postdoctorale. De plus, les résident·es ont reçu des commentaires liés à leurs forces et leurs actes sur les deux évaluations à des fréquences comparables, quel que soit le genre du corps professoral. CONCLUSION: Nous n'avons constaté aucune différence fondée sur le genre dans les cotes de confiance telles qu'évaluées par les ACEA et les APNS, ce qui suggère une absence de préjugés genrés envers les résident·es au sein de ce système de FMFC. Compte tenu de l'hétérogénéité considérable en matière de clémence des évaluateurs et évaluatrices, les travaux futurs seraient plus fiables s'ils utilisaient des scores ajustés en fonction de ladite clémence plutôt que des scores bruts.

Difficult or impossible facemask ventilation in children with difficult tracheal intubation: a retrospective analysis of the PeDI registry.

BACKGROUND: Difficult facemask ventilation is perilous in children whose tracheas are difficult to intubate. We hypothesised that certain physical characteristics and anaesthetic factors are associated with difficult mask ventilation in paediatric patients who also had difficult tracheal intubation. METHODS: We queried a multicentre registry for children who experienced "difficult" or "impossible" facemask ventilation. Patient and case factors known before mask ventilation attempt were included for consideration in this regularised multivariable regression analysis. Incidence of complications, and frequency and efficacy of rescue placement of a supraglottic airway device were also tabulated. Changes in quality of mask ventilation after injection of a neuromuscular blocking agent were assessed. RESULTS: The incidence of difficult mask ventilation was 9% (483 of 5453 patients). Infants and patients having increased weight, being less than 5th percentile in weight for age, or having Treacher-Collins syndrome, glossoptosis, or limited mouth opening were more likely to have difficult mask ventilation. Anaesthetic induction using facemask and opioids was associated with decreased risk of difficult mask ventilation. The incidence of complications was significantly higher in patients with "difficult" mask ventilation than in patients without. Rescue placement of a supraglottic airway improved ventilation in 71% (96 of 135) of cases. Administration of neuromuscular blocking agents was more frequently associated with improvement or no change in quality of ventilation than with worsening. CONCLUSIONS: Certain abnormalities on physical examination should increase suspicion of possible difficult facemask ventilation. Rescue use of a supraglottic airway device in children with difficult or impossible mask ventilation should be strongly considered.

Patient and Process Outcomes among Pediatric Patients Undergoing Appendectomy during the COVID-19 Pandemic: An International Retrospective Cohort Study.

BACKGROUND: COVID-19 forced healthcare systems to make unprecedented changes in clinical care processes. The authors hypothesized that the COVID-19 pandemic adversely impacted timely access to care, perioperative processes, and clinical outcomes for pediatric patients undergoing primary appendectomy. METHODS: A retrospective, international, multicenter study was conducted using matched cohorts within participating centers of the international PEdiatric Anesthesia COVID-19 Collaborative (PEACOC). Patients younger than 18 yr old were matched using age, American Society of Anesthesiologists Physical Status, and sex. The primary outcome was the difference in hospital length of stay of patients undergoing primary appendectomy during a 2-month period early in the COVID-19 pandemic (April to May 2020) compared with prepandemic (April to May 2019). Secondary outcomes included time to appendectomy and the incidence of complicated appendicitis. RESULTS: A total of 3,351 cases from 28 institutions were available with 1,684 cases in the prepandemic cohort matched to 1,618 in the pandemic cohort. Hospital length of stay was statistically significantly different between the two groups: 29 h (interquartile range: 18 to 79) in the pandemic cohort versus 28 h (interquartile range: 18 to 67) in the prepandemic cohort (adjusted coefficient, 1 [95% CI, 0.39 to 1.61]; P < 0.001), but this difference was small. Eight centers demonstrated a statistically significantly longer hospital length of stay in the pandemic period than in the prepandemic period, while 13 were shorter and 7 did not observe a statistically significant difference. During the pandemic period, there was a greater occurrence of complicated appendicitis, prepandemic 313 (18.6%) versus pandemic 389 (24.1%), an absolute difference of 5.5% (adjusted odds ratio, 1.32 [95% CI, 1.1 to 1.59]; P = 0.003). Preoperative SARS-CoV-2 testing was associated with significantly longer time-to-appendectomy, 720 min (interquartile range: 430 to 1,112) with testing versus 414 min (interquartile range: 231 to 770) without testing, adjusted coefficient, 306 min (95% CI, 241 to 371; P < 0.001), and longer hospital length of stay, 31 h (interquartile range: 20 to 83) with testing versus 24 h (interquartile range: 14 to 68) without testing, adjusted coefficient, 7.0 (95% CI, 2.7 to 11.3; P = 0.002). CONCLUSIONS: For children undergoing appendectomy, the COVID-19 pandemic did not significantly impact hospital length of stay.

Standardized Anesthesia InductioN Tool (SAINT) - The development and international adoption of an integrated electronic tool for documenting the induction of anesthesia in children.

BACKGROUND: The induction of anesthesia in children poses a challenge for the anesthesiologist, the parent and child. Anxiety and negative behaviours and strategies that effectively mitigate should be documented accurately and be available for future patient encounters. To address the need for a structured and standardized electronic documentation tool. AIMS: Our aim was to develop a comprehensive electronic tool to capture and report behaviours during induction of anesthesia. METHODS: We performed a literature search on existing validated tools for documenting behaviours during anesthesia induction. We used the nominal group technique to achieve agreement on the components to include. We used Agile software development techniques to design and review the integrated electronic tool. Twelve international hospitals informed the development of the tool. RESULTS: We developed an electronic tool, the Standardized Anesthesia InductioN Tool (SAINT). SAINT incorporates validated scales for documenting key stages of the anesthesia induction journey (separation from caregivers, mask acceptance, induction behaviour, parental presence, the use of adjuncts and their effectiveness). In addition, the standardised data elements used in SAINT allow for local reporting, quality metrics and can assist in data across multi-centre trials. To date the tool has been adopted by 133 institutions across four countries and is freely available. CONCLUSION: We show that collaborative development and rapid adoption of the comprehensive induction tool SAINT has led to its rapid adoption in the routine practice of pediatric anesthesiology across several countries. Further studies on how the SAINT is being used for quality improvement or research are warranted.

Effect of Wearing a Face Mask on Hand-to-Face Contact by Children in a Simulated School Environment: The Back-to-School COVID-19 Simulation Randomized Clinical Trial.

Importance: Wearing a face mask in school can reduce SARS-CoV-2 transmission but it may also lead to increased hand-to-face contact, which in turn could increase infection risk through self-inoculation. Objective: To evaluate the effect of wearing a face mask on hand-to-face contact by children while at school. Design, Setting, and Participants: This prospective randomized clinical trial randomized students from junior kindergarten to grade 12 at 2 schools in Toronto, Ontario, Canada, during August 2020 in a 1:1 ratio to either a mask or control class during a 2-day school simulation. Classes were video recorded from 4 angles to accurately capture outcomes. Interventions: Participants in the mask arm were instructed to bring their own mask and wear it at all times. Students assigned to control classes were not required to mask at any time (grade 4 and lower) or in the classroom where physical distancing could be maintained (grade 5 and up). Main Outcomes and Measures: The primary outcome was the number of hand-to-face contacts per student per hour on day 2 of the simulation. Secondary outcomes included hand-to-mucosa contacts and hand-to-nonmucosa contacts. A mixed Poisson regression model was used to derive rate ratios (RRs), adjusted for age and sex with a random intercept for class with bootstrapped 95% CIs. Results: A total of 174 students underwent randomization and 171 students (mask group, 50.6% male; control group, 52.4% male) attended school on day 2. The rate of hand-to-face contacts did not differ significantly between the mask and the control groups (88.2 vs 88.7 events per student per hour; RR, 1.00; 95% CI, 0.78-1.28; P = >.99). When compared with the control group, the rate of hand-to-mucosa contacts was significantly lower in the mask group (RR, 0.12; 95% CI, 0.07-0.21), while the rate of hand-to-nonmucosa contacts was higher (RR, 1.40; 95% CI, 1.08-1.82). Conclusions and Relevance: In this clinical trial of simulated school attendance, hand-to-face contacts did not differ among students required to wear face masks vs students not required to wear face masks; however, hand-to-mucosa contracts were lower in the face mask group. This suggests that mask wearing is unlikely to increase infection risk through self-inoculation. Trial Registration: ClinicalTrials.gov Identifier: NCT04531254.

Safe in the first attempt: teaching neonatal airway management.

PURPOSE OF REVIEW: Quick and precise facemask ventilation and tracheal intubation are critical clinical skills in neonatal airway management. In addition, this vulnerable population requires a thorough understanding of developmental airway anatomy and respiratory physiology to manage and anticipate potential airway mishaps. Neonates have greater oxygen consumption, increased minute ventilation relative to functional residual capacity, and increased closing volumes compared to older children and adults. After a missed airway attempt, this combination can quickly lead to dire consequences, such as cardiac arrest. Keeping neonates safe throughout the first attempt of airway management is key. RECENT FINDINGS: Several techniques and practices have evolved to improve neonatal airway management, including improvement in neonatal airway equipment, provision of passive oxygenation, and closer attention to the management of anesthetic depth. The role of nontechnical skills during airway management is receiving more recognition. SUMMARY: Every neonatal intubation should be considered a critical event. Below we discuss some of the challenges in neonatal airway management, including anatomical and physiological principles which must be understood to approach the airway. We then follow with a description of current evidence for best practices and training.

Return to school and mask-wearing in class during the COVID-19 pandemic: Student perspectives from a school simulation study.

Objectives: This study examined children's perspectives about returning to in-person school following lockdown due to the pandemic and about mask-wearing in class, as well as the mental health of children and parents during the pandemic. Methods: This cross-sectional study was part of a 2-day school simulation exercise that randomized students to different masking recommendations. Parent-report of mental health and post-simulation child-report of COVID-19-related anxiety and mask-wearing were analyzed using descriptive and multiple regression analyses. Semi-structured focus groups were conducted with older students to supplement questionnaire data. Results: Of 190 students in this study, 31% were in grade 4 or lower 95% looked forward to returning to in-person school. Greater child anxiety about COVID-19 was predicted by increased parent/caregiver anxiety (ß=0.67; P<0.001), and lower parental educational attainment (ß=1.86; P<0.002). Older students were more likely than younger students to report that mask-wearing interfered with their abilities to interact with peers (χ2(1)=31.16; P<0.001) and understand the teacher (χ2(1)=13.97; P<0.001). Students in the group that did not require masks were more likely than students in the masking group to report worries about contracting COVID-19 at school (χ2(1)=10.07; P<0.05), and anticipated difficulty wearing a mask (χ2(1)=18.95; P<0.001). Conclusions: For children anxious about COVID-19, parental anxiety and education about COVID-19 may be targets for intervention. Future research should examine the impact of prolonged implementation of public health mitigation strategies in school on academic achievement and children's mental health.

Impact of COVID-19 Public Health Protocols on Teachers Instructing Children and Adolescents During an In-Person Simulation.

Objective: As a result of the COVID-19 pandemic, public health agencies and school boards across Canada enacted new protocols, including face masks, physical distancing and enhanced hygiene, to support the safe reopening of in-person school. This study explored the experiences and perceptions of teachers instructing children and adolescents in person during a two-day school simulation. Method: This study was part of a large school simulation exercise conducted in Toronto, Ontario. Kindergarten to grade 12 teachers taught in classrooms with either masked students, or students who were un-masked or only masked when physical distancing was not possible. A qualitative descriptive phenomenology approach was utilized, and data were collected via virtual focus groups. Qualitative data analysis involved multiple rounds of inductive coding to generate themes. Results: The sample included 14 teachers (92.9% female; 85.7% White), with a median of 9.5 years teaching experience. Three primary themes emerged: 1) learning to navigate public health measures, 2) needing to adapt teaching strategies and 3) striving to manage conflicting priorities. The majority of teachers reported that mask-wearing and physical distancing impacted their classroom teaching, communication and connection with students. Conclusions: As schools transition to in-person instruction, teachers will be required to play dual roles in education and public health, with implications on safety, teaching and professional identity. Public health agencies and school boards are encouraged to engage teachers in ongoing conversations regarding in-person school planning and operations. Furthermore, evidence-based interventions, including increased teaching development programs, are recommended to support teachers during the COVID-19 pandemic.

Objectif: Conséquemment à la pandémie de la COVID-19, les organismes de santé publique et les conseils scolaires de tout le Canada ont mis en œuvre de nouveaux protocoles, notamment des masques, une distanciation physique et une hygiène accrue, afin de soutenir la réouverture prudente de l'école en personne. La présente étude a exploré les expériences et les perceptions des professeurs instruisant les enfants et les adolescents en personne durant une simulation scolaire de deux jours. Méthode: La présente étude faisait partie d'un grand exercice de simulation scolaire mené à Toronto, Ontario. Les professeurs de la maternelle à la 12e année enseignaient dans des classes où les élèves étaient soit masqués, soit non masqués, soit seulement masqués quand la distanciation physique n'était pas possible. Une approche de phénoménologie qualitative descriptive a été utilisée, et les données ont été recueillies par des groupes de discussion virtuels. L'analyse des données qualitatives impliquait de multiples rondes de codage inductif pour générer des thèmes. Résultats: L'échantillon comportait 14 professeurs (92,9 % de sexe féminin; 85,7 % Blancs), avec une moyenne de 9,5 années d'expérience d'enseignement. Trois principaux thèmes ont émergé : 1) apprendre à naviguer les mesures de santé publique, 2) la nécessité d'adapter les stratégies d'enseignement et 3) s'efforcer de gérer les priorités conflictuelles. La majorité des professeurs a déclaré que le port du masque et la distanciation physique influaient sur leur enseignement en classe, sur la communication et la connexion avec les élèves. Conclusions: Tandis que les écoles font la transition à l'enseignement en personne, les professeurs devront assumer des doubles rôles en éducation et en santé publique, impliquant la sécurité, l'enseignement et l'identité professionnelle. Les organismes de santé publique et les conseils scolaires sont invités à faire participer les professeurs à des conversations actuelles relativement à la planification et aux activités de l'école en personne. En outre, les interventions fondées sur des données probantes, notamment les programmes accrus de développement de l'enseignement, sont recommandées pour soutenir les professeurs durant la pandémie de la COVID-19.

Validity evidence for the Anesthesia Clinical Encounter Assessment (ACEA) tool to support competency-based medical education.

BACKGROUND: Workplace-based assessment (WBA) is key to a competency-based assessment strategy. Concomitantly with our programme's launch of competency-based medical education, we developed an entrustment-based WBA, the Anesthesia Clinical Encounter Assessment (ACEA), to assess readiness for independent practice of competencies essential to perioperative patient care. This study aimed to examine validity evidence of the ACEA during postgraduate anaesthesiology training. METHODS: The ACEA comprises an eight-item global rating scale (GRS), an overall independence rating, an eight-item checklist, and case details. ACEA data were extracted for University of Toronto anaesthesia residents from July 2017 to January 2020 from the programme's online assessment portal. Validity evidence was generated following Messick's validity framework, including response process, internal structure, relations with other variables, and consequences. RESULTS: We analysed 8664 assessments for 137 residents completed by 342 assessors. From generalisability analysis, 10 independent observations (two assessments each from five assessors) were sufficient to achieve a reliability threshold of ≥0.70 for in-training assessments. A composite GRS score of 3.65/5 provided optimal sensitivity (93.6%) and specificity (90.8%) for determining entrustment on receiver operator characteristic curve analysis. Test-retest reliability was high (intraclass correlation coefficient [ICC2,1]=0.81) for matched assessments within 14 days of each other. Composite GRS scores differed significantly between residents based on their training level (P<0.0001) and correlated highly with overall independence (0.91, P<0.001). The internal consistency of the GRS (α=0.96) was excellent. CONCLUSIONS: This study supports the validity of the ACEA for assessing the competence of residents performing perioperative care and supports its use in competency-based anaesthesiology training.